A Mobile Cloud Computing Based Independent Language Learning System With Automatic Intelligibility Assessment and Instant Feedback
Published in 2018 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computing, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovations, 2018
Recommended citation: I. Kasrani, M. M. Vasoya, A. Shivakumar, and Y. Pei, "A Mobile Cloud Computing Based Independent Language Learning System with Automatic Intelligibility Assessment and Instant Feedback", The 14th International Conference on Mobile Learning (Mobile Learning 2018), Lisbon, Portugal, April 14-16, 2018.
In this research paper, we present a novel language learning/training and assessment system that helps people to learn and practice a new language independently at low cost. To achieve an independent-learning workflow, we explore the use of real-time speech recognition, language translation, speech synthesis, and language intelligibility assessment technologies to provide automatic assessment and instant feedback of language-speaking performance. We also propose and adopt an objective assessment methodology that determines the intelligibility based on outcome of speech recognition. Our experimental results demonstrate that the proposed system can sufficiently analyze the intelligibility of ones speaking, accurately identify mispronounced words, and define a feedback that localizes and highlights errors for helping continuous practice toward perfection.